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Abstract. We present an abstract machine and a reduction semantics for the lambda- 
calculus extended with control operators that give access to delimited continuations in 
the GPS hierarchy. The abstract machine is derived from an evaluator in continuation- 
passing style (GPS); the reduction semantics (i.e., a small-step operational semantics with 
an explicit representation of evaluation contexts) is constructed from the abstract machine; 
and the control operators are the shift and reset family. 

We also present new applications of delimited continuations in the GPS hierarchy: 
finding list prefixes and normalization by evaluation for a hierarchical language of units 
and products. 



1. Introduction 

The studies of delimited continuations can be classified in two groups: those that use 
continuation-passing style (CPS) and those that rely on operational intuitions about con- 
trol instead. Of the latter, there is a large number proposing a variety of control opera- 
tors [5,37,40,41,49,52,53,65,70,74,80] which have found applications in models of control, 
concurrency, and type-directed partial evaluation [8,52,75]. Of the former, there is the work 
revolving around the family of control operators shift and reset [27-29,32,42,43,55,56,66,80] 
which have found applications in non-deterministic programming, code generation, par- 
tial evaluation, normalization by evaluation, computational monads, and mobile comput- 
ing [6, 7, 9, 17, 22, 23, 33, 34, 44, 46, 48, 51,57, 59, 61, 72, 77-79] . 

The original motivation for shift and reset was a continuation-based programming pat- 
tern involving several layers of continuations. The original specification of these operators 
relied both on a repeated CPS transformation and on an evaluator with several layers 
of continuations (as is obtained by repeatedly transforming a direct-style evaluator into 
continuation-passing style). Only subsequently have shift and reset been specified opera- 
tionally, by developing operational analogues of a continuation semantics and of the CPS 
transformation [32]. 
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The goal of our work here is to estabhsh a new operational foundation for delimited 
continuations, using CPS as a guideline. To this end, we start with the original evaluator 
for shifti and reseti. This evaluator uses two layers of continuations: a continuation and a 
meta-continuation. We then defunctionalize it into an abstract machine [1] and we construct 
the corresponding reduction semantics [36], as pioneered by Felleisen and Friedman [39]. 
The development scales to shift„ and resets . It is reusable for any control operators that 
are compatible with CPS, i.e., that can be characterized with a (possibly iterated) CPS 
translation or with a continuation-based evaluator. It also pinpoints where operational 
intuitions go beyond CPS. 

This article is structured as follows. In Section [2 we review the enabling technol- 
ogy of our work: Reynolds's defunctionalization, the observation that a defunctionalized 
CPS program implements an abstract machine, and the observation that Felleisen's eval- 
uation contexts are the defunctionalized continuations of a continuation-passing evaluator; 
we demonstrate this enabling technology on a simple example, arithmetic expressions. In 
Section |3J we illustrate the use of shift and reset with the classic example of finding list 
prefixes, using an ML-like programming language. In Section |^ we then present our main 
result: starting from the original evaluator for shift and reset, we defunctionalize it into 
an abstract machine; we analyze this abstract machine and construct the corresponding 
reduction semantics. In Section|Sl we extend this result to the CPS hierarchy. In Sectional 
we illustrate the CPS hierarchy with a class of normalization functions for a hierarchical 
language of units and products. 

2. From evaluator to reduction semantics for arithmetic expressions 

We demonstrate the derivation from an evaluator to a reduction semantics. The deriva- 
tion consists of the following steps: 

(1) we start from an evaluator for a given language; if it is in direct style, we CPS- 
transform it; 

(2) we defunctionalize the CPS evaluator, obtaining a value-based abstract machine; 

(3) we modify the abstract machine to make it term-based instead of value-based; in 
particular, if the evaluator uses an environment, then so does the corresponding 
value-based abstract machine, and in that case, making the machine term-based 
leads us to use substitutions rather than an environment; 

(4) we analyze the transitions of the term-based abstract machine to identify the eval- 
uation strategy it implements and the set of reductions it performs; the result is a 
reduction semantics. 

The first two steps are based on previous work on a functional correspondence between 
evaluators and abstract machines [1-3,17,26], which itself is based on Reynolds's seminal 
work on definitional interpreters [71]. The last two steps follow the lines of Felleisen and 
Friedman's original work on a reduction semantics for the call-by-value A-calculus extended 
with control operators [39]. The last step has been studied further by Hardin, Maranget, 
and Pagano [50] in the context of explicit substitutions and by Biernacka, Danvy, and 
Nielsen [15,16,31]. 

In the rest of this section, our running example is the language of arithmetic expressions, 
formed using natural numbers (the values) and additions (the computations): 

exp 9 e ::= ^m? \ ei + 62 
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• Values: val B v ::= m 

• Evaluation function: eval : exp — > val 

eval CrrP) = m 
eval (ei + 62) = eval (ei) + eval (62) 

• Main function: evaluate : exp val 

evaluate (e) = eval (e) 

Figure 1: A direct-style evaluator for arithmetic expressions 



• Values: val 3 v ::= m 

• Continuations: cent = val — > val 

• Evaluation function: eval : exp x cent — > val 

eval CnP, k) = k m 
eval (ei + 62, k) = eval (ei, Ami. eval (e2, Xm2- k {nii + m2))) 

• Main function: evaluate : exp val 

evaluate (e) = eval (e, Af.v) 

Figure 2: A continuation-passing evaluator for arithmetic expressions 



2.1. The starting point: an evaluator in direct style. We define an evaluation func- 
tion for arithmetic expressions by structural induction on their syntax. The resulting direct- 
style evaluator is displayed in Figure ^ 

2.2. CPS transformation. We CPS-transform the evaluator by naming intermediate re- 
sults, sequentializing their computation, and introducing an extra functional parameter, 
the continuation [29,68,76]. The resulting continuation-passing evaluator is displayed in 
Figure 121 

2.3. Defunctionalization. The generalization of closure conversion [60] to defunctional- 
ization is due to Reynolds [71] . The goal is to represent a functional value with a first-order 
data structure. The means is to partition the function space into a first-order sum where 
each summand corresponds to a lambda-abstraction in the program. In a defunctionalized 
program, function introduction is thus represented as an injection, and function elimination 
as a call to a first-order apply function implementing a case dispatch. In an ML-like func- 
tional language, sums are represented as data types, injections as data-type constructors, 
and apply functions are defined by case over the corresponding data types [30] . 

Here, we defunctionalize the continuation of the continuation-passing evaluator in Fig- 
ure [21 We thus need to define a first-order algebraic data type and its apply function. To 
this end, we enumerate the lambda-abstractions that give rise to the inhabitants of this 
function space; there are three: the initial continuation in evaluate and the two continua- 
tions in eval. The initial continuation is closed, and therefore the corresponding algebraic 
constructor is nullary. The two other continuations have two free variables, and therefore 
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• Values: val B v ::= m 

• Defunctionalized continuations: cent 9 k ::= [] j ADD2 (e, k) \ ADDi (v, k) 

• Functions eval : exp x cent — > val and apply_cont : cent x val — > val: 



eval CrrP, k) 
eval (ei + 62, k) 



apply_cont (A;, m) 
eval (ei, ADD2 (e2, k)) 



apply_cont ([ ], v) 
apply_cont (ADD2 (e2, k), vi) 
apply_cont (ADDi (mi, k), 1712) 

• Main function: evaluate : exp — > val 



V 



eval (62, ADDi {vi, k)) 
apply_cont {k, mi + 711,2) 



evaluate (e) 



eval (1 



e, []) 



Figure 3: A defunctionalized continuation-passing evaluator for arithmetic expressions 



the corresponding constructors are binary. As for the apply function, it interprets the 
algebraic constructors. The resulting defunctionalized evaluator is displayed in Figure 01 

2.4. Abstract machines as defunctionalized continuation-passing programs. Else- 
where [1,26], we have observed that a defunctionalized continuation-passing program im- 
plements an abstract machine: each configuration is the name of a function together with 
its arguments, and each function clause represents a transition. (As a corollary, we have 
also observed that the defunctionalized continuation of an evaluator forms what is known 
as an 'evaluation context' [25,30,39].) 

Indeed Plotkin's Indifference Theorem [68] states that continuation-passing programs 
are independent of their evaluation order. In Reynolds's words [71], all the subterms in 
applications are 'trivial'; and in Moggi's words [64], these subterms are values and not 
computations. Furthermore, continuation-passing programs are tail recursive [76]. There- 
fore, since in a continuation-passing program all calls are tail calls and all subcomputations 
are elementary, a defunctionalized continuation-passing program implements a transition 
system [69], i.e., an abstract machine. 

We thus reformat Figure 01 into Figure 01 The correctness of the abstract machine with 
respect to the initial evaluator follows from the correctness of CPS transformation and of 
defunctionalization. 

2.5. From value-based abstract machine to term-based abstract machine. We 

observe that the domain of expressible values in Figure El can be embedded in the syntactic 
domain of expressions. We therefore adapt the abstract machine to work on terms rather 
than on values. The result is displayed in Figure it is a syntactic theory [36]. 

2.6. From term-based abstract machine to reduction semantics. The method of 
deriving a reduction semantics from an abstract machine was introduced by Felleisen and 
Friedman [39] to give a reduction semantics for control operators. Let us demonstrate it. 

We analyze the transitions of the abstract machine in Figure jSl The second component 
of e?;a/-transitions — the stack representing "the rest of the computation" — has already been 
identified as the evaluation context of the currently processed expression. We thus read a 
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• Values: v ::= m 

• Evaluation contexts: C ::= [] | ADD2 (e, C) | ADDi {v, C) 

• Initial transition, transition rules, and final transition: 

e ^ (e, [])eval 

CrrP, C)eval ^ (C, rn)cont 

(ei + 62, C)eval (ci, ADD2 (62, C))ei;a; 

(ADD2 (62, C), ■Ui)^,,^* ^ (62, ADDi {Vi, C))eval 

(ADDi (mi, C), m2)cont (C, mi + m2)cont 

{[],v)cont ^ 

Figure 4: A value-based abstract machine for evaluating arithmetic expressions 



• Expressions and values: e ::= v \ 61 + 62 

V ::= ''nP 

• Evaluation contexts: C ::= [] \ ADD2 (e, C) \ ADDi {v, C) 

• Initial transition, transition rules, and final transition: 



(e, []) 



eval 



CirP, C)eval =^ {C, '~nP)cont 
(61 + 62, C)eval ^ (ei, ADD2 (62, C)) eval 

(ADD2 (62, C), Vi)cont (62, ADDi {vi, C))eval 

(ADDi ("rnr, C), ''m'P)cont ^ (C, "^i + ^2"') cent 

([], ^^)cont ^ 

Figure 5: A term-based abstract machine for processing arithmetic expressions 



configuration {e, C)eval as a decomposition of some expression into a sub-expression e and 
an evaluation context C. 

Next, we identify the reduction and decomposition rules in the transitions of the ma- 
chine. Since a configuration can be read as a decomposition, we compare the left-hand side 
and the right-hand side of each transition. If they represent the same expression, then the 
given transition defines a decomposition (i.e., it searches for the next redex according to 
some evaluation strategy); otherwise we have found a redex. Moreover, reading the decom- 
position rules from right to left defines a 'plug' function that reconstructs an expression 
from its decomposition. 

Here the decomposition function as read off the abstract machine is total. In general, 
however, it may be undefined for stuck terms; one can then extend it straightforwardly into 
a total function that decomposes a term into a context and a potential redex, i.e., an actual 
redex (as read off the machine), or a stuck redex. 
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In this simple example there is only one reduction rule. This rule performs the addition 
of natural numbers: 

(add) C [^m{^ + ^rri'P] C ['"m-i + m-P] 

The remaining transitions decompose an expression according to the left-to-right strategy. 

2.7. From reduction semantics to term-based abstract machine. In Section 12.61 
we have constructed the reduction semantics corresponding to the abstract machine of 
Figure as pioneered by Felleisen and Friedman [38,39]. Over the last few years [15, 
16,24,31], Biernacka, Danvy, and Nielsen have studied the converse transformation and 
systematized the construction of an abstract machine from a reduction semantics. The 
main idea is to short-cut the decompose-contract-plug loop, in the definition of evaluation 
as the transitive closure of one-step reduction, into a refocus-contract loop. The refocus 
function is constructed as an efficient (i.e., deforested) composition of plug and decompose 
that maps a term and a context either to a value or to a redex and a context. The result 
is a 'pre-abstract machine' computing the transitive closure of the refocus function. This 
pre-abstract machine can then be simplified into an eval/apply abstract machine. 

It is simple to verify that using refocusing, one can go from the reduction semantics of 
Section [2. 61 to the eval/apply abstract machine of Figure El 

2.8. Summary and conclusion. We have demonstrated how to derive an abstract ma- 
chine out of an evaluator, and how to construct the corresponding reduction semantics out 
of this abstract machine. In Section HI we apply this derivation and this construction to the 
first level of the CPS hierarchy, and in Section |21 we apply them to an arbitrary level of the 
CPS hierarchy. But first, let us illustrate how to program with delimited continuations. 

3. Programming with delimited gontinuations 

We present two examples of programming with delimited continuations. Given a list 
xs and a predicate p, we want 

(1) to find the first prefix of xs whose last element satisfies p, and 

(2) to find all such prefixes of xs. 

For example, given the predicate Xm.m > 2 and the list [0,3,1,4,2,5], the first prefix is 
[0, 3] and the list of all the prefixes is [[0, 3], [0, 3, 1, 4], [0, 3, 1, 4, 2, 5]]. 

In Section 13.11 we start with a simple solution that uses a first-order accumulator. 
This simple solution is in defunctionalized form. In Section [3.21 we present its higher-order 
counterpart, which uses a functional accumulator. This functional accumulator acts as a 
delimited continuation. In Section [3.3[ we present its direct-style counterpart (which uses 
shift and reset) and in Section [3.4( we present its continuation-passing counterpart (which 
uses two layers of continuations). In Section [3. 5[ we introduce the CPS hierarchy informally. 
We then mention a typing issue in Section 13.61 and review related work in Section 13.71 

3.1. Finding prefixes by accumulating lists. A simple solution is to accumulate the 
prefix of the given list in reverse order while traversing this list and testing each of its 
elements: 

• if no element satisfies the predicate, there is no prefix and the result is the empty 
list; 

• otherwise, the prefix is the reverse of the accumulator. 
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find -first _prefix_a {p, xs) = letrec visit {nil, a) 

= nil 
I visit [x :: xs, a) 
= let a' = X :: a 
in if p X 

then reverse {a', nil) 
else visit {xs, a') 
and reverse {nil, xs) 
= xs 

I reverse {x :: a, xs) 
— 'pgygj-gQ {a^ X :: xs) 
in visit {xs, nil) 

find -all -prefixes -a {p, xs) =^ letrec visit {nil, a) 

= nil 
I visit {x :: xs, a) 
= let a' = X :: a 

in if p X 

then {reverse {a' , nil)) :: {visit {xs, a')) 
else visit {xs, a') 
and reverse {nil, xs) 

= xs 

I reverse {x :: a, xs) 
= reverse {a, x :: xs) 
in visit {xs, nil) 

To find the first prefix, one stops as soon as a satisfactory list element is found. To list 
all the prefixes, one continues the traversal, adding the current prefix to the list of the 
remaining prefixes. 

We observe that the two solutions are in defunctionalized form [30,71]: the accumulator 
has the data type of a defunctionalized function and reverse is its apply function. We present 
its higher-order counterpart next [54]. 

3.2. Finding prefixes by accumulating list constructors. Instead of accumulating the 
prefix in reverse order while traversing the given list, we accumulate a function constructing 
the prefix: 

• if no element satisfies the predicate, the result is the empty list; 

• otherwise, we apply the functional accumulator to construct the prefix. 
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find _first -prefix -Ci {p, xs) = letrec visit [nil, k) 

= nil 
I visit {x :: xs, k) 
= let k' = Xvs.k {x :: vs) 
in if p X 
then k' nil 
else visit (xs, k') 
in visit {xs, Xvs.vs) 

find -all -prefixes -Ci {p, xs) '== letrec visit {nil, k) 

= nil 
I visit {x :: xs, k) 
= let k' = Xvs.k {x :: vs) 
in if p X 

then {k' nil) :: {visit {xs, k')) 
else visit {xs, k') 
in visit {xs, Xvs.vs) 

To find the first prefix, one applies the functional accumulator as soon as a satisfactory list 
element is found. To list all such prefixes, one continues the traversal, adding the current 
prefix to the list of the remaining prefixes. 

Defunctionalizing these two definitions yields the two definitions of Section f3. 11 

The functional accumulator is a delimited continuation: 

• In find -first -prefix -Ci, visit is written in CPS since all calls are tail calls and all 
sub-computations are elementary. The continuation is initialized in the initial call 
to visit, discarded in the base case, extended in the induction case, and used if a 
satisfactory prefix is found. 

• In find -all -prefixes -Ci, visit is almost written in CPS except that the continuation is 
composed if a satisfactory prefix is found: it is used twice — once where it is applied 
to the empty list to construct a prefix, and once in the visit of the rest of the list to 
construct a list of prefixes; this prefix is then prepended to this list of prefixes. 

These continuation-based programming patterns (initializing a continuation, not using it, 
or using it more than once as if it were a composable function) have motivated the control 
operators shift and reset [28,29]. Using them, in the next section, we write visit in direct 
style. 

3.3. Finding prefixes in direct style. The two following local functions are the direct- 
style counterpart of the two local functions in Section 13.21 

find -first -prefix -Cq {p, xs) =^ letrec visit nil 

= Sk.nil 
I visit {x :: xs) 
= X :: {if p X then nil else visit xs) 
in {visit xs) 
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find -all -prefixes -Cq {p, xs) = letrec visit nil 

= Sk.nil 
I visit {x :: xs) 
= X :: if p X 

then Sk'.{k' nil) :: {k' (visit xs)) 
else visit xs 

in {visit xs) 

In both cases, visit is in direct style, i.e., it is not passed any continuation. The initial calls 
to visit are enclosed in the control delimiter reset (noted (•) for conciseness). In the base 
cases, the current (delimited) continuation is captured with the control operator shift (noted 
S), which has the effect of emptying the (delimited) context; this captured continuation is 
bound to an identifier k, which is not used; nil is then returned in the emptied context. 
In the induction case oi find -all -prefixes -Cq, if the predicate is satisfied, visit captures the 
current continuation and applies it twice — once to the empty list to construct a prefix, and 
once to the result of visiting the rest of the list to construct a list of prefixes; this prefix is 
then prepended to the list of prefixes. 

CPS-transforming these two local functions yields the two definitions of Section [29]. 

3.4. Finding prefixes in continuation-passing style. The two following local functions 
are the continuation-passing counterpart of the two local functions in Section 13.21 

find -first -prefix -C2 [p, xs) '= letrec visit {nil, ki, k2) 

= ^2 nil 
I visit {x :: xs, ki, k2) 
= let k[ = X{vs, k'2).ki {x :: vs, k'2) 
in if p X 

then k[ {nil, k2) 
else visit {xs, k[, ^2) 
in visit {xs, X{vs, k2).k2 vs, Xvs.vs) 

find -all -prefixes -C2 {p, xs) *== letrec visit {nil, ki, k2) 

= k2 nil 
I visit {x :: xs, ki, k2) 
= let k[ = X{vs, ^2)-^! {x ■■ vs, k'2) 
in if p X 

then k[ {nil, Xvs. visit {xs, k[, Xvss.k2 {vs :: vss))) 
else visit {xs, k[, ^2) 
in visit {xs, X{vs, k2).k2 vs, Xvss.vss) 

CPS-transforming the two local functions of Section 13.21 adds another layer of continua- 
tions and restores the syntactic characterization of all calls being tail calls and all sub- 
computations being elementary. 

3.5. The CPS hierarchy. If k2 were used non-tail recursively in a variant of the examples 
of Section|231 we could CPS-transform the definitions one more time, adding one more layer 
of continuations and restoring the syntactic characterization of all calls being tail calls and 
all sub-computations being elementary. We could also map this definition back to direct 
style, eliminating k2 but accessing it with shift. If the result were mapped back to direct 
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style one more time, /c2 would then be accessed with a new control operator, shift2, and ki 
would be accessed with shift (or more precisely with shifti). 

All in all, successive CPS-transformations induce a CPS hierarchy [28,32], and abstract- 
ing control up to each successive layer is achieved with successive pairs of control operators 
shift and reset — reset to initialize the continuation up to a level, and shift to capture a 
delimited continuation up to this level. Each pair of control operators is indexed by the 
corresponding level in the hierarchy. Applying a captured continuation packages all the 
current layers on the next layer and restores the captured layers. When a captured continu- 
ation completes, the packaged layers are put back into place and the computation proceeds. 
(This informal description is made precise in Section^) 

3.6. A note about typing. The type find -all _pre fixes -Ci, in Section f3. 21 is 

(a — > bool) X a list — > a list list 

and the type of its local function visit is 

a list X (a list — > a list) — > a list list. 

In this example, the co-domain of the continuation is not the same as the co-domain of 
visit. 

Thus find _all -prefixes -Cq provides a simple and meaningful example where Filinski's 
typing of shift [42] does not fit, since it must be used at type 

((/3 — > ans) ans) — > (3 

for a given type ans, i.e., the answer type of the continuation and the type of the computa- 
tion must be the same. In other words, control effects are not allowed to change the types 
of the contexts. Due to a similar restriction on the type of shift, the example does not fit 
either in Murthy's pseudo-classical type system for the CPS hierarchy [66] and in Wadler's 
most general monadic type system [80, Section 3.4]. It however fits in Danvy and Filinski's 
original type system [27] which Ariola, Herbelin, and Sabry have recently embedded in 
classical subtractive logic [5]. 

3.7. Related work. The example considered in this section builds on the simpler function 
that unconditionally lists the successive prefixes of a given list. This simpler function is a 
traditional example of delimited continuations [21,73]: 

• In the Lisp Pointers [21], Danvy presents three versions of this function: a typed 
continuation-passing version (corresponding to Section r3.2|l . one with delimited con- 
trol (corresponding to Section . and one in assembly language. 

• In his PhD thesis [73, Section 6.3], Sitaram presents two versions of this function: 
one with an accumulator (corresponding to Section 13.1(1 and one with delimited 
control (corresponding to Section IT^ . 

In Section 13.21 we have shown that the continuation-passing version mediates the version 
with an accumulator and the version with delimited control since defunctionalizing the 
continuation-passing version yields one and mapping it back to direct style yields the other. 

3.8. Summary and conclusion. We have illustrated delimited continuations with the 
classic example of finding list prefixes, using CPS as a guideline. Direct-style programs using 
shift and reset can be CPS-transformed into continuation-passing programs where some 
calls may not be tail calls and some sub-computations may not be elementary. One more 
CPS transformation establishes this syntactic property with a second layer of continuations. 
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• Terms: term 3 t ::= ''nP \ x \ Xx.t | to^i I sued \ {t) \ Sk.t 

• Values: val 3 v ::= m \ f 

• Answers, meta-continuations, continuations and functions: 

ans = val 

k2 € cont2 = val ans 

ki € conti = val X cont2 — > ans 

/ G fun = val x conti x cont2 —>■ ans 

• Initial continuation and meta-continuation: 9i = X(v, k2)-k2 v 

02 = Xv. V 

• Environments: env B e ::= Cempty \ ^ v] 

• Evaluation function: eval : term x env x conti x cont2 — > ans 



eval CmP, 


e, ki, 


k2) 


= ki (m, k2) 


eval (x. 


e, ki, 


k2) 


= ki {e{x), k2) 


eval (Xx.t, 


e, ki, 


k2) 


= ki {X{v, k[, k2).eva\ {t, e[x i-^ v], k[, k'2), ^2) 


eval {to ti, 


e, ki, 


k2) 


= eval (to, e, A(/, A;^).eval (ti, e, X{v, ^2)-/ {v 


eval {succ t, 


e, ki, 


k2) 


= eval (t, e, A(m, k'2).ki (m + l, k'2), k2) 


eval {{t), 


e, ki, 


k2) 


= eval (t, e, 61, Xv.ki {v, k2)) 


eval {Sk.t, 


e, ki, 


k2) 


= eval (t, e[k ^ c], 9i, /C2) 

where c = X{v, k'l, k'2). ki {v, Xv' . k'l {v' , k'2)) 



• Main function: evaluate : term val 



evaluate (t) = eval {t, e empty, Oi, 62) 
Figure 6: An environment-based evaluator for the first level of the CPS hierarchy 



Further CPS transformations provide the extra layers of continuation that are characteristic 
of the CPS hierarchy. 

In the next section, we specify the A-calculus extended with shift and reset. 

4. From evaluator to reduction semantics for delimited continuations 

We derive a reduction semantics for the call-by-value A-calculus extended with shift and 
reset, using the method demonstrated in Section [5J First, we transform an evaluator into 
an environment-based abstract machine. Then we eliminate the environment from this 
abstract machine, making it substitution-based. Finally, we read all the components of a 
reduction semantics off the substitution-based abstract machine. 

Terms consist of integer literals, variables, A-abstractions, function applications, appli- 
cations of the successor function, reset expressions, and shift expressions: 

t ::= ''m? \ x \ Xx.t \ toti \ succt \ {t) \ Sk.t 

Programs are closed terms. 
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This source language is a subset of the language used in the examples of Section El 
Adding the remaining constructs is a straightforward exercise and does not contribute to 
our point here. 

4.1. An environment-based evaluator. Figure 1^1 displays an evaluator for the language 
of the first level of the CPS hierarchy. This evaluation function represents the original 
call-by- value semantics of the A-calculus with shift and reset [28], augmented with integer 
literals and applications of the successor function. It is defined by structural induction 
over the syntax of terms, and it makes use of an environment e, a continuation ki, and a 
meta-continuation /c2. 

The evaluation of a terminating program that does not get stuck (i.e., a program where 
no ill- formed applications occur in the course of evaluation) yields either an integer, a 
function representing a A-abstraction, or a captured continuation. Both evaluate and aval 
are partial functions to account for non-terminating or stuck programs. The environment 
stores previously computed values of the free variables of the term under evaluation. 

The meta-continuation intervenes to interpret reset expressions and to apply captured 
continuations. Otherwise, it is passively threaded through the evaluation of literals, vari- 
ables, A-abstractions, function applications, and applications of the successor function. (If 
it were not for shift and reset, and if eval were curried, k2 could be eta-reduced and the 
evaluator would be in ordinary continuation-passing style.) 

The reset control operator is used to delimit control. A reset expression (t) is inter- 
preted by evaluating t with the initial continuation and a meta-continuation on which the 
current continuation has been "pushed." (Indeed, and as will be shown in Section 14. 2[ 
defunctionalizing the meta-continuation yields the data type of a stack [30].) 

The shift control operator is used to abstract (delimited) control. A shift expression 
Sk.t is interpreted by capturing the current continuation, binding it to k, and evaluating t 
in an environment extended with k and with a continuation reset to the initial continuation. 
Applying a captured continuation is achieved by "pushing" the current continuation on the 
meta-continuation and applying the captured continuation to the new meta-continuation. 
Resuming a continuation is achieved by reactivating the "pushed" continuation with the 
corresponding meta-continuation. 

4.2. An environment-based abstract machine. The evaluator displayed in Figure IHl 
is already in continuation-passing style. Therefore, we only need to defunctionalize its ex- 
pressible values and its continuations to obtain an abstract machine. This abstract machine 
is displayed in Figure [7J 

The abstract machine consists of three sets of transitions: eval for interpreting terms, 
conti for interpreting the defunctionalized continuations (i.e., the evaluation contexts),^ and 
cont2 for interpreting the defunctionalized meta-continuations (i.e., the meta-contexts).^ 
The set of possible values includes integers, closures and captured contexts. In the original 

-'^The grammar of evaluation contexts in Figure |7| is isomorphic to the grammar of evaluation contexts in 
the standard inside-out notation: 

Ci [] I Ci[[] {t,e)] \ Ci[succ []] \ Ci[v []] 

^To build on Peyton Jones's terminology [62], this abstract machine is therefore in 'eval/apply/meta- 
apply' form. 
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evaluator, the latter two were represented as higher-order functions, but defunctionahzing 
expressible values of the evaluator has led them to be distinguished. 

This eval/apply/meta-apply abstract machine is an extension of the CEK machine [39], 
which is an eval/apply machine, with the meta-context C2 and its two transitions, and 
the two transitions for shift and reset. C2 intervenes to process reset expressions and to 
apply captured continuations. Otherwise, it is passively threaded through the processing of 
literals, variables, A-abstractions, function applications, and applications of the successor 
function. (If it were not for shift and reset, C2 and its transitions could be omitted and the 
abstract machine would reduce to the CEK machine.) 

Given an environment e, a context Ci, and a meta-context C2, a reset expression (t) 
is processed by evaluating t with the same environment e, the empty context •, and a 
meta-context where Ci has been pushed on C2. 

Given an environment e, a context Ci, and a meta-context C2, a shift expression Sk.t is 
processed by evaluating t with an extension of e where k denotes Ci , the empty context [ ] , 
and a meta-context C2. Applying a captured context C[ is achieved by pushing the current 
context Ci on the current meta-context C2 and continuing with C[. Resuming a context 
Ci is achieved by popping it off the meta-context C2 • Ci and continuing with Ci. 

The correctness of the abstract machine with respect to the evaluator is a consequence 
of the correctness of defunctionalization. In order to express it formally, we define a partial 
function eval^ mapping a term t to a value v whenever the environment-based machine, 
started with t, stops with v. The following theorem states this correctness by relating 
observable results: 

Theorem 1. For any program t and any integer value m, evaluate (i) = m if and only if 
eval^ (i) = m. 

Proof. The theorem follows directly from the correctness of defunctionalization [10,67]. □ 

The environment-based abstract machine can serve both as a foundation for imple- 
menting functional languages with control operators for delimited continuations and as a 
stepping stone in theoretical studies of shift and reset. In the rest of this section, we use it 
to construct a reduction semantics of shift and reset. 

4.3. A substitution-based abstract machine. The environment-based abstract ma- 
chine of Figure [3 on which we want to base our development, makes a distinction between 
terms and values. Since a reduction semantics is specified by purely syntactic operations 
(it gives meaning to terms by specifying their rewriting strategy and an appropriate notion 
of reduction, and is indeed also referred to as 'syntactic theory'), we need to embed the 
domain of values back into the syntax. To this end we transform the environment-based 
abstract machine into the substitution-based abstract machine displayed in Figure |SJ The 
transformation is standard, except that we also need to embed evaluation contexts in the 
syntax; hence the substitution-based machine operates on terms where "quoted" (in the 
sense of Lisp) contexts can occur. (If it were not for shift and reset, C2 and its transitions 
could be omitted and the abstract machine would reduce to the CK machine [39].) 

We write t{v/x} to denote the result of the usual capture- avoiding substitution of the 
value V for x in t. 

Formally, the relationship between the two machines is expressed with the following 
simulation theorem, where evaluation with the substitution-based abstract machine is cap- 
tured by the partial function evaP, defined analogously to eval^. 
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• Terms: t ::= '~m? \ x \ Xx.t \ to^i I sued \ {t) \ Sk.t 

• Values (integers, closures, and captured continuations): v :: = 

• Environments: e ::= e empty \ e[x v] 

• Evaluation contexts: Ci ::= [] | ARG((t, e), Ci) | SUCC(Ci; 

• Meta-contexts: C2 ::= • | C2 • Ci 

• Initial transition, transition rules, and final transition: 



m 



I [x, t, 
F\JN{v, 



e] I Ci 
Ci) 



{^rrP, e, Ci 

(a;, e, Ci 

{Xx.t, e, Ci 

(to^i, e, Ci 

(succ i, e, Ci 

((0, e, Ci 

(<SA;.t, e, Ci 



C2)eval 
C2)eval 
C2)eval 
C2)eval 
C2)eval 
C2)eval 
C2)eval 



{[],V, C2)conti 

(ARG((t,e),Ci), V, C2) conti 
(SUCC(Ci), m, C2)conu 
(FUN([x, e],Ci), t;, C2) conti 
{FUN{C[,Ci),v,C2) conti 

{C2 ■ Ci 

(•) v) cont2 



(Ci, e(a;), C2)contj 

(Ci, [x, t, e], C2) conti 

{to, e, ARG((ti,e),Ci), C2) 

{t, e, SUGG(Ci), C2)eval 

{t, e, [], C2-Ci) 

eval 

{t, e[k ^Ci], [], C2)eval 

{C2, v)cont2 

{t, e, FUN{v,Ci),C2)eval 

(Ci, m + 1, C2) conti 

{t, e[x ^ v], Ci, C2)eval 

{C[, V, C2 ■ Ci) 

conti 

(Ci, V, C2) conti 



eval 



Figure 7: An environment-based abstract machine for the first level of the CPS hierarchy 



Theorem 2. For any program t, either both evaP {t) and evaT (t) are undefined, or there 
exist values v, v' such that eval^ (t) = v, eval^ (t) = v' and T{v') = v. The function T relates 
a semantic value with its syntactic representation and is defined as follows:^ 

T{m) = ''nP 

T{[x,t,e]) = Xx.t{T{e{xi))/xi}...{r{e{xn))/xa}, 
where FV {Xx. t) = {xi, . . . , Xn} 

nu) = [] 

r(ARG((i,e),Ci)) = ARG(t{T(e(xi))M}...{T(e(xn))/a;„},T(Ci)), 

where FV {t) = {xi, . . . , Xn\ 
r(FUN(^;,Ci)) = Fm{T{v),T{Ci)) 

r(succ(Ci)) = succ(r(Ci)) 



'T is a generalization of Plotkin's function Real [68]. 
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• Terms and values: t ::= v \ x \ IqIi \ succ t \ (t) \ Sk.t 

V ::= '~rrp \ Xx.t \ Ci 

• Evaluation contexts: Ci ::= [] \ ARG(t,Ci) 1 SUCC(Ci) | FUN(t>,Ci) 

• Meta-contexts: C2 ::= • | C2 ■ Ci 

• Initial transition, transition rules, and final transition: 

* ^ *)eval 

(W, Ci, C2)eval =^ (Cl, 'W, C2)conti 

{Xx.t, Cl, C2)eval =^ (Cl, Xx.t, C2) conti 

{C'l, Cl, C2)eval ^ {Cl, C'l, C2) conti 

{t^ti, Cl, C2) eval => (^O, ARG(ti, Cl), C2)ei.ai 

{succ t, Cl, C2)eval => {t, SUCC(Ci), C2) eval 

Cl, C2)eval =^ {t, [], C2 ■ Cl) eval 

{Sk.t, Ci,C2) eval ^ {t{Cl/k],[\,C2)eval 

conti ^ (C2 1 cont2 

(ARG(t,Ci), V, C2)conU ^ {t, FUN(t;,C7i), C2)eval 

(SUGG(Ci), ^m^, C2)eont, ^ {Cl,^m+V,C2)conU 

(FUN(Ax.t,Ci), V, C2)conU =^ {t{v/x}, Cl, C2)eval 

(FUN(C7{,Ci), V, C2) conti 

^ (C(, C2-Ci) 

conti 

{C2-Ci,v) 

cont2 ^ (Ci,^;, C2) conti 
{; v)eont2 => V 

Figure 8: A substitution-based abstract machine for the first level of the CPS hierarchy 



Proof. We extend the translation function T to meta-contexts and configurations, in the 
expected way, e.g., 

r((t, e, Cl, C2)e.a/) = {t{T{e{xi))/xi} . . . {T{e{Xn))/Xn}, T{Ci), T{C2))eval 

where FV (t) = {xi, . . . , Xn} 

Then it is straightforward to show that the two abstract machines operate in lock step with 
respect to the translation. Hence, for any program t, both machines diverge or they both 
stop (after the same number of transitions) with the values v and T{v), respectively. □ 

We now proceed to analyze the transitions of the machine displayed in Figure |H1 We 
can think of a configuration {t, Ci, C2)evai as the following decomposition of the initial term 
into a meta-context C2, a context Ci, and an intermediate term t: 

C2#Ci[t] 

where # separates the context and the meta-context. Each transition performs either a 
reduction, or a decomposition in search of the next redex. Let us recall that a decomposition 
is performed when both sides of a transition are partitions of the same term; in that case, 
depending on the structure of the decomposition C2 # Ci[t], a subpart of the term is chosen 
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to be evaluated next, and the contexts are updated accordingly. We also observe that eval- 
transitions follow the structure of t, conf i-transitions follow the structure of Ci when the 
term has been reduced to a value, and co??i2-transitions follow the structure of C2 when a 
value in the empty context has been reached. 

Next we specify all the components of the reduction semantics based on the analysis of 
the abstract machine. 

4.4. A reduction semantics. A reduction semantics provides a reduction relation on 
expressions by defining values, evaluation contexts, and redexes [36,38,39,82]. In the 
present case, 

• the values are already specified in the (substitution-based) abstract machine: 

V .:= ''rrP \ Xx.t \ Ci 

• the evaluation contexts and meta-contexts are already specified in the abstract ma- 
chine, as the data-type part of defunctionalized continuations; 

Ci::=[] I ARG(t,Ci) | FUN(u,Ci) | SUCC(Ci) 

C2 ■•= • I C2 ■ Ci 

• we can read the redexes off the transitions of the abstract machine: 

r ::= succ ''rrP \ {\x.t)v \ Sk.t \ C[v \ {v) 

Based on the distinction between decomposition and reduction, we single out the fol- 
lowing reduction rules from the transitions of the machine: 



{5) 


C2 # Ci [succ W] - 


C2#Ci[^m + r] 




C2#Ci[{Xx.t)v] - 


C2#Ci[t{v/x}] 




C2#Ci[Sk.t] - 


C2#[t{C\/k}] 


{/3ctx) 


C2#Ci[C[v] - 


C2-Ci#C[[v] 


(Reset) 


C2#Ci[{v)] - 


C2#Ci[v] 



{(3\) is the usual call-by-value /^-reduction; we have renamed it to indicate that the applied 
term is a A-abstr action, since we can also apply a captured context, as in (Pctx)- (Sx) is 
plausibly symmetric to (/?>,) — it can be seen as an application of the abstraction Xk.t to 
the current context. Moreover, (Pctx) can be seen as performing both a reduction and a 
decomposition: it is a reduction because an application of a context with a hole to a value 
is reduced to the value plugged into the hole; and it is a decomposition because it changes 
the mcta-contcxt, as if the application were enclosed in a reset. Finally, (Reset) makes 
it possible to pass the boundary of a context when the term inside this context has been 
reduced to a value. 

The /Jctx-i'ule and the ^A-rule give a justification for representing a captured context Ci 
as a term Ax.(Ci[x]), as found in other studies of shift and reset [55,56,66]. In particular, 
the need for delimiting the captured context is a consequence of the /3cte-rule. 
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Finally, we can read the decomposition function off the transitions of the abstract 
machine: 

deco'mpose{t) = decompose' (t, [], •) 

decompose' (toil, Ci, C2) = decompose' {to, ARG{ti,Ci), C2) 

decompose' {succ t, Ci, C2) = decompose' {t, S[JCC{Ci), C2) 

decompose' {{t), Ci, C2) = decompose' (t, [], C2 • Ci) 

decompose' {v, ARG(t, Ci), C2) = decompose' {t, FUN('U, Ci), C2) 

In the remaining cases either a value or a redex has been found: 

decompose' (f, [], •) = • # [v\ 

decompose' {v, [], C2 ■ Ci) = C2 # Ci[{v)] 

decompose' (Sk.t, Ci, C2) = C2 # Ci[Sk.t\ 

decompose' {v, FUN((Aa;i), Ci), C2) = C2 # Ci[{Xx.t) v] 

decompose' {v, FUN(C(, Ci), C2) = C2 # Cijcj v] 

decompose' CrrP, SUCC(Ci), C2) = C2 # Ci[succ 'W] 

An inverse of the decompose function, traditionally called plug, reconstructs a term 
from its decomposition: 

plug (•#[*]) = t 

plug {C2 ■ Ci # [t]) = plug iC2 # Ci[{t)]) 

plug{C2#{ARG{t',Ci))[t]) = plug {C2 # Ci[tt']) 

plug{C2# iFUN{v,Ci)) [t]) = plug (02 # Ci [v t]) 

plug iC2 # iSUCC{Ci))[t]) = plug IC2 # Ci[succ t]) 

In order to talk about unique decomposition, we need to define the set of potential 
redexes (i.e., the disjoint union of actual redexes and stuck redexes). The grammar of 
potential redexes reads as follows: 

p ::= succ V \ vqVi \ Sk.t \ {v) 

Lemma 1 (Unique decomposition). A program t is either a value v or there exist a 
unique context Ci, a unique meta-context C2 and a potential redex p such that t = 
plug {C2 # Ci[jo]). In the former case decompose {t) = • # [v] and in the latter case either 
decompose{t) = C2 # Ci\p] if p is an actual redex, or decompose{t) is undefined. 

Proof. The first part follows by induction on the structure of t. The second part follows 
from the equation decompose {plug {C2 # Ci[r])) = C2 # Ci[r] which holds for all C2, Ci and 
r. □ 

It is evident that evaluating a program either using the derived reduction rules or using 
the substitution-based abstract machine yields the same result. 

Theorem 3. For any program t and any value v, eval^ (t) = v if and only ift ^* v, where 
— is the reflexive, transitive closure of the one-step reduction defined by the relation 

Proof. When evaluating with the abstract machine, each contraction is followed by decom- 
posing the contractum in the current context and meta-context. When evaluating with 
the reduction rules, however, each contraction is followed by plugging the contractum and 
decomposing the resulting term. Therefore, the theorem follows from the equation 

decompose' {t, C\, C2) = decompose {plug {C2 # C'i[i])) 

which holds for any C2, Ci and t. □ 
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We have verified that using refocusing [16,31], one can go from this reduction semantics 
to the abstract machine of Figure |H1 

4.5. Beyond CPS. Alternatively to using the meta-context to compose dehmited contin- 
uations, as in Figure [7J we could compose them by concatenating their representation [41]. 
Such a concatenation function is defined as follows: 

[]^C[ = C[ 

(ARG((t,e),Ci))*C( = ARG((t,e),Ci*C;) 

(SUCC(Ci))*C( = SUCC(Ci*C() 

(FUN(i;,Ci))*C7( = FUN(t;,Ci*CO 

(The second clause would read (ARG(t,Ci)) * = ARG(f,Ci ★ C[) for the contexts of 
Figure H) 

Then, in Figures [T] and |S1 we could replace the transition 

(FUN(C(,Ci), V, C2) conti conti 

by the following one: 

(FUN(C7(,Ci), V, C2) conti conti 

This replacement changes the control effect of shift to that of Felleisen et al.'s J- opera- 
tor [37]. Furthermore, the modified abstract machine is in structural correspondence with 
Felleisen et al.'s abstract machine for and ^ [37,41]. 

This representation of control (as a list of 'stack frames') and this implementation of 
composing delimited continuations (by concatenating these lists) are at the heart of virtually 
all non-CPS-based accounts of delimited control. However, the modified environment-based 
abstract machine does not correspond to a defunctionalized continuation-passing evaluator 
because it is not in the range of defunctionalization [30] since the first-order representation 
of functions should have a single point of consumption. Here, the constructors of contexts 
are not solely consumed by the conti transitions of the abstract machine as in Figures [7| 
and ISJ but also by Therefore, the abstract machine that uses ★ is not in the range of 
Reynolds's defunctionalization and it thus does not immediately correspond to a higher- 
order, continuation-passing evaluator. In that sense, control operators using ★ go beyond 
CPS. 

Elsewhere [18], we have rephrased the modified abstract machine to put it in defunc- 
tionalized form, and we have exhibited the corresponding higher-order evaluator and the 
corresponding 'dynamic' continuation-passing style. This dynamic CPS is not just plain 
CPS but is a form of continuation-l-state-passing style where the threaded state is a list of 
intermediate delimited continuations. Unexpectedly, it is also in structural correspondence 
with the architecture for delimited control recently proposed by Dybvig, Peyton Jones, and 
Sabry on other operational grounds [35]. 

4.6. Static vs. dynamic delimited continuations. Irrespectively of any new dynamic 
CPS and any new architecture for delimited control, there seems to be remarkably few 
examples that actually illustrate the expressive power of dynamic delimited continuations. 
We have recently presented one, breadth-first traversal [19], and we present another one 
below. 
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The two following functions traverse a given list and return another list. The recursive 

call to visit is abstracted into a delimited continuation, which is applied to the tail of the 
list: 

foo xs =^ letrec visit nil bar xs letrec visit nil 

= nil = nil 

visit {x :: xs) \ visit {x :: xs) 

= visit {Sk.x :: {k xs)) = visit {J^k.x .: {k xs)) 

in {visit xs) in {visit xs) 

On the left, foo uses S and on the right, bar uses J^; for the rest, the two definitions are 
identical. Given an input list, foo cop ies it and bar reverses it. 

To explain this difference and to account for the extended source language, we need to 
expand the grammar of evaluation contexts, e.g., with a production to account for calls to 
the list constructor: 

Ci ::= [] I ARG(t,Ci) | SUCC(Ci) | FUN(f,Ci) | CONS(t;,Ci) | ... 

Similarly, we need to expand the definition of concatenation as follows: 

(CONS(w,Ci))*C( = CONS(«,Ci*C() 

Here is a trace of the two computations in the form of the calls to and returns from 
visit for the input list 1 :: 2 :: nil: 

foo: Every time the captured continuation is resumed, its representation is kept sep- 
arate from the current context. The mcta-context therefore grows whereas the 
captured context solely consists of FiiN{visit,[]) throughout (writing visit in the 
context for simplicity): 

C2 # Ci[{visit{l :: 2 :: nil))] 
C2 • Ci # [visit (1 :: 2 :: nil)] 
C2 • Ci • (C0NS(1, [ ])) # [visit (2 :: nil)] 
C2 • Ci • (C0NS(1, [ ])) • (C0NS(2, [ ])) # [visit ml] 
C2 • Ci • (C0NS(1, [ ])) • (C0NS(2, [ ])) # [nil] 

C2-Ci-(C0NS(1,[])) # [2:: nil] 

C2 • Ci # [1 :: 2 :: nil] 
C2 # Ci[l :: 2 :: nil] 

bar: Every time the captured continuation is resumed, its representation is concate- 
nated to the current context. The mcta-context therefore remains the same whereas 
the context changes dynamically. The first captured context is F(JN{visit, []); con- 
catenating it to C0NS(1,[]) yields C0NS(1, FUN(wsii, [ ])), which is the second 
captured context: 

C2 # Ci[{visit{l :: 2 :: nil))] 
C2 • Ci # [visit (1 :: 2 :: nil)] 
C2 • Ci # (C0NS(1, []))[msit (2 :: nil)] 
C2-Ci# (C0NS(2,C0NS(l,[])))[OTsiim/] 
C2-Ci# (C0NS(2,C0NS(1,[])))[to/] 
C2 -Ci # (C0NS(2, []))[1 :: nil] 
C2 • Ci # [2 :: 1 :: nil] 

C2 # Ci[2 :: 1 :: nil] 
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4.7. Summary and conclusion. We have presented the original evaluator for the A- 
calculus with shift and reset; this evaluator uses two layers of continuations. From this 
call-by-value evaluator we have derived two abstract machines, an environment-based one 
and a substitution-based one; each of these machines uses two layers of evaluation contexts. 
Based on the substitution-based machine we have constructed a reduction semantics for 
the A-calculus with shift and reset; this reduction semantics, by construction, is sound with 
respect to CPS. Finally, we have pointed out the difference between the static and dynamic 
delimited control operators at the level of the abstract machine and we have presented a 
simple but meaningful example illustrating their differing behavior. 

5. From evaluator to reduction semantics for the CPS hierarchy 

We construct a reduction semantics for the call-by-value A-calculus extended with shifty 
and reset„ . As in Section 1^ we go from an evaluator to an environment-based abstract 
machine, and from a substitution-based abstract machine to a reduction semantics. Be- 
cause of the regularity of CPS, the results can be generalized from level 1 to higher levels 
without repeating the actual construction, based only on the original specification of the 
hierarchy [28]. In particular, the proofs of the theorems generalize straightforwardly from 
level 1. 

5.1. An environment-based evaluator. At the nth level of the hierarchy, the language 
is extended with operators shift j and reset j for all i such that 1 < i < n. The evaluator 
for this language is shown in Figures l9l and [Till If n = 1, it coincides with the evaluator 
displayed in Figure El 

The evaluator uses n+1 layers of continuations. In the five first clauses (literal, variable, 
A-abstraction, function application, and application of the successor function), the contin- 
uations A;2, • • • , kn+i are passive: if the evaluator were curried, they could be eta-reduced. 
In the clauses defining shiftj and resets, the continuations ki+2, ■ ■ ■ , ^n+i are also passive. 
Each pair of control operators is indexed by the corresponding level in the hierarchy: resetj 
is used to "push" each successive continuation up to level i onto level i + 1 and to reinitialize 



• Terms (1 < i < n): term 3 t ::= '~m? \ x \ Xx.t \ toti \ succ t \ {t)i \ Sik.t 

• Values: val 3 v ::= m \ f 

• Answers, continuations and functions (1 < « < n): 







ans 


= val 










■n+l 


e 


cont„+i 


= val 




ans 






ki 


G 


cent,; 


= val 


X 


COnt,;_|_i X . . . 


X cont„,+i - 


ans 


f 


G 


fun 


= val 


X 


conti X . . . 


X cont„+i - 


-> ans 



• Initial continuations {1 < i < n): 

9i = \{v, ki+i, ki+2, ■ ■ ■, kn+i)- ki+i {v, ki+2, ■ ■ ■, kn+i) 

dn+l = Xv.V 

• Environments: env 9 e ::= eempty \ e.[x i— > v\ 

• Evaluation function: see Figure [TUl 



Figure 9: An environment-based evaluator for the CPS hierarchy at level n 



Evaluation function (1 < i < n): eval„ : term x env x conti x ... x cont„+i — > ans 



evain Cm?, 


e, 


fci, k2, 


■-, kn+l) 


= ki (m, k2, .. 
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eval„ (x, 


e, 


ki, k2, 
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= ki {e{x), k2 


, kn+l) 
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e, 


ki, k2, 
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= ki (A(f, k[, 


k'2i •••> ^n+l)-^V3'n (^, ^[^ '*^], ^1, k'2i ■■ 




••, kn+l) 


eval„ (toil, 


e, 


ki, k2, 


kn+l) 


= eval„ (to, e, 









A(/, /c^, A;^+i).evaln (ti, e, 

A(i;, /C2, ^n+l)-/ ('^, ^1, ^2, ^n+l), 

^2, A;n+l) 

eval„ [succ t, e, ki, k2, kn+i) = eval„ (t, e, A(m, ^3, /c'^+i)- ki {m + 1, k'^, ^2, kn+i) 

eval„ e, ki, ^2, = eval^ {t, e, Oi, Oi, X{v, fc^_^2> -> ^2, -, Ar^+i, A;^+2> -1 ^n+i)> ^i+2, -, Wi) 

eval„ {Sik.t, e, A;i, ^2, kn+i) = eval„ (t, e[k c^], 6*1, 9i, ki+i, kn+i) 

where Ci = X{v, k'l, k!^^i).ki {v, k2, ki, X{v', A;^+2, ^n+i)-^i {"v', k2, ^i+i, ^f+2, ^n+i)) ^'1+2, ^n+i) 
• Main function: evaluaten : term — > val 

evaluate„(t) = eval„ {t, Cempty, di, -, ^n, 6*71+1) 



Figure 10: An environment-based evaluator for the CPS hierarchy at level n, ctd. 
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them with 9i,. . . ,6i, which are the successive CPS counterparts of the identity function; 
shiftj is used to abstract control up to level i into a delimited continuation and to reinitialize 
the successive continuations up to level i with 9i, . . . ,9i. 

Applying a delimited continuation that was abstracted up to level i "pushes" each 
successive continuation up to level i onto level i + 1 and restores the successive continua- 
tions that were captured in a delimited continuation. When such a delimited continuation 
completes, and when an expression delimited by resets completes, the successive continua- 
tions that were pushed onto level i + 1 are "popped" back into place and the computation 
proceeds. 

5.2. An environment-based abstract machine. Defunctionalizing the evaluator of Fig- 
ures IHl and ^1 yields the environment-based abstract machine displayed in Figures ^2 ^-nd 
1121 If n = 1, it coincides with the abstract machine displayed in Figure [7J 

The abstract machine consists of n + 2 sets of transitions: eval for interpreting terms 
and conti, . . . , contn+i for interpreting the successive defunctionalized continuations. The 
set of possible values includes integers, closures and captured contexts. 

This abstract machine is an extension of the abstract machine displayed in Figure d 
with n + 1 contexts instead of 2 and the corresponding transitions for shift j and reset,. 
Each metaj+i-context intervenes to process reset, expressions and to apply captured con- 
tinuations. Otherwise, the successive contexts are passively threaded to process literals, 
variables, A-abstr actions, function applications, and applications of the successor function. 

Given an environment e and a series of successive contexts, a reset, expression (t), is 
processed by evaluating t with the same environment e, i empty contexts, and a metaj+i- 
context over which all the intermediate contexts have been pushed on. 

Given an environment e and a series of successive contexts, a shift expression Sik.t 
is processed by evaluating t with an extension of e where k denotes a composition of the 
i surrounding contexts, i empty contexts, and the remaining outer contexts. Applying a 
captured context is achieved by pushing all the current contexts on the next outer context, 
restoring the composition of the captured contexts, and continuing with them. Resuming 
a composition of captured contexts is achieved by popping them off the next outer context 
and continuing with them. 

In order to relate the resulting abstract machine to the evaluator, we define a partial 
function eval^ mapping a term f to a value v whenever the machine for level n, started with 



• Terms (1 < i < n): t ::= ^m? \ x j \x.t \ t^ti \ succ t \ {t)i \ Sik.t 

• Values (1 < i < n): v ::= m \ [x, t, e] \ Ci 

• Evaluation contexts {2 < i < n + \): 



• Environments: e ::= eempty \ e[x ^ v] 

• Initial transition, transition rules, and final transition: see Figure IT^ 

Figure 11: An environment-based abstract machine for the CPS hierarchy at level n 



Ci ::= [] [ ARG((t,e),Ci) [ SUCC(Ci) [ FUN(v,Ci) 




Initial transition, transition rules, and final transition {1 < i < n, 2 < j < n): 

t -- 



(W, e, Ci 
(x, e, Ci 



C2, . 
C2, . 
C2, . 
C2, . 
C2, . 
C2, . 
C2, . 



Cn+l) eval 
^n+l) eval 
Cn+l) eval 
Cn+l) eval 
Cn+l) eval 
Cn+l) eval 
Cn+l) eval 



{Xx.t, e, Ci 
{toil, e, Ci 
(sMcc t, e, Ci 
e, Ci 
{Sik.t, e, Ci 

([], V, C2, C„+i) 

conti 
conti 

(SUCC(Ci), m, C2, C„+ 

1) conti 

(FUN([x, t, e],Ci), C2, C„+i)conti 

(FUN(C; • (...(C^ • CO-.), C-l), C2, Cn+l)conU 

contj 

(Cj ■ (...(C2 • Ci)...), V, Cj+i, Cn+l) contj 
{Cn+l ■ (•••(C2 • Ci)...), f)coni„+, 
([ ], v) contn+l 



{tj empty ^ []) []> [])ei'a/ 
(Ci, m, C2, Cn+l) conti 

(Ci, e(a;), C2, C„+i) 

(Ci, [x, t, e], C2, Cn+l) conti 

(to, e, ARG((ti, e), Ci), C2, Cn+l)eval 
(t, e, SUCC(Ci), C2, Cn+l) eval 
{t, e,[], ...,[], a+i-(...(C2-Ci)..0 
{t, e[k^Ci-i...iC2-Ci)...)], [],...., 

(C2, V, C3, C„+i) 
{t, e, FUN(i;,Ci), C2, Cn+i) eval 
(Ci, m + 1, C2, Cn+l) conti 

{t, e[x ^ v], Ci, C2, Cn+l)eval 
{C[, V, C2, C-, Cj+i • (...(C2 • Ci 

(Cj+i, U, Cj+2! Cn+l)contj+i 
(Ci, U, C2, Cn+l) conti 

(Ci, U, C2, Cn+l) conti 



Ci+2, ■■■ 

[], Cj+i, 



Cn+l) eval 
■•■) Cn+l)eval 



c 



i+2, 



Cn+l) 



n+1/ contj 



Figure 12: An environment-based abstract machine for the CPS hierarchy at level n, ctd. 
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t, stops with V. The correctness of the machine with respect to the evaluator is ensured by 
the following theorem: 

Theorem 4. For any program t and any integer value m, evaluate^ (t) = m if and only if 
eval^ (t) = m. □ 

5.3. A substitution-based abstract machine. In the same fashion as in Section r4.3l we 

construct the substitution-based abstract machine corresponding to the environment-based 
abstract machine of Section [5.21 The result is displayed in Figures IT^ and ITU If n = 1, it 
coincides with the abstract machine displayed in Figure |S1 

The nth level contains n + 1 evaluation contexts and each context Ci can be viewed as 
a stack of non-empty contexts Cj_i. Terms are decomposed as 

Cn-1 #n-2 • • • #2 C2 #1 Ci[t], 

where each #j represents a context delimiter of level i. All the control operators that occur 
at the jth level (with j < n) of the hierarchy do not use the contexts j + 2, . . . ,n + 1. The 
functions decompose and its inverse plug can be read off the machine, as for level 1. 

The transitions of the machine for level j are "embedded" in the machine for level j + 1; 
the extra components are threaded but not used. 

We define a partial function eval^ capturing the evaluation by the substitution-based 
abstract machine for an arbitrary level n, analogously to the definition of eval^. Now we can 
relate evaluation with the environment-based and the substitution-based abstract machines 
for level n. 

Theorem 5. For any program t, either both eval^ {t) and eval^ {t) are undefined, or there 
exist values v,v' such that eval^ (t) = v, eval^ (t) = v' and Tn {v') = v. 

The definition of Tn extends that of T from Theorem\^in such a way that it is homo- 
morphic for all the contexts Ci, with 2 < i < n. □ 

5.4. A reduction semantics. Along the same lines as in Section 14.41 we construct the 
reduction semantics for the CPS hierarchy based on the abstract machine of Figures 
and 1141 For an arbitrary level n we obtain the following set of reduction rules, for all 



• Terms and values (1 < i < n): t ::= v \ x \ t^ti \ succ t \ {t)i \ Sik.t 

V ::= ''rrf \ Xx.t \ Ci 

• Evaluation contexts (2 < z < n -|- 1): 

Ci ::= [] I ARG(t,Ci) | SUCC(Ci) [ FUN(^;,Ci) 
Cj ::= [ ] I Ci ■ Cj_i 

• Initial transition, transition rules, and final transition: see Figure ITU 

Figure 13: A substitution-based abstract machine for the CPS hierarchy at level n 



Initial transition, transition rules, and final transition (1 < i < n, 2 < j < n): 



{^rrP, Ci, C2, . 
{Xx.t, Ci, C2, . 

{CI, Ci, C2, . 
{to ti, Ci, C2, ■ 
{succ t, Ci, C2, ■ 

{{t)i, Ci, C2, . 

{Sik.t, Ci, C2, . 



Cn+l) eval 
Cn+l) eval 

C/i+l) eval 
C-n+l) eval 
C-n+l) eval 
Cn+l) eval 
Cn+l) eval 



{[]: C2, Cn+l)conti =^ 

(ARG(t,Ci),t;, C2, ...,Cn+i) 

(SUCC(Ci), ^m^, C2, Cn+l)conU ^ 

1) conti 

(FUN(C; • {...{C'2 ■ Cl), V, C2, Cn+l)cont, - 

([], V, Cj+i, Cn+ 1 ) contj ~' 

{Cj ■ (...(C2 • Ci)...), V, Cj+i, Cn+l) contj ~' 

{Cn+l ■ {...{C2 ■ Ci)...), v)cont^^, - 

([ Jj v)contn+i ^ 

Figure 14: A substitution-based abstract 



■ («,[],[],-, [])e.ai 

■ (Ci, C[, C2, c„+ 

1 ) conti 

■ (to, ARG((ti, e),Ci), C2, 

■ {t, SUCC(Ci), C2, Cn+l) eval 

■ {t, [], [], Cj+i • (...(C2 -Ci)...), Ci+2, C'-re+l)ei)ai 

■ {t{Ci ■ (...(C2 • Ci)...)/fc}, [], [], Cj+i, Cn+l)eval 

■ {C2, V, C3, Cn+l) contg 

■ {t, FUN{V, Ci), C2, Cn+l) eval 

■ {C^,^m + V,C2, ...,Cn+ 1) conti 

■ {t{v/x}, Ci, C2, Cn+l)eval 

■ {C[, V, C2, Cj+i • (...(C2 • Ci)...), Ci+2, Cn+l)conti 

■ {Cl, V, C2, C„+i) 

conti 

■ {Cl, V, C2, Cn+l) conti 

■ V 

machine for the the CPS hierarchy at level n, ctd. 
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1 < i < n; they define the actual redexes: 





Cn+1 




• #1 Ci[succ ^m?] -^n Cn+1 #n ' ' ' #1 Ci['~m + V] 




Cn+1 




■ #1 Ci[{Xx.t) V] -^n Cn+1 #n ■■■ #1 Ci[t{v/x}] 


(SI) 


Cn+1 




■ #1 Ci[Sik.t] ^n 




Cn+1 




■ C,+i #i[]...#i [t{Ci • (. . . (C2 • Ci) . . .)/k}] 


iPctx) 


Cn+1 




■ #lC7l[c^(...(c^c7^)...)^] ^„ 




Cn+1 




• C,+i • (. . . (C2 • Ci) . . .) #i #^-l ■■■ #lC[[v 


(Reset^) 


Cn+1 




■ #1 ^n Cn+1 #n ■■■ #1 Ci[v] 



Each level contains all the reductions from lower levels, and these reductions are com- 
patible with additional layers of evaluation contexts. In particular, at level there are only 
5- and /JA-reductions. 

The values and evaluation contexts are already specified in the abstract machine. More- 
over, the potential redexes are defined according to the following grammar: 

Pn ■■= succ V \ vqVi \ Sik.t \ {v)i (1 < i < n) 

Lemma 2 (Unique decomposition for level n). A program t is either a value or there 
exists a unique sequence of contexts Ci,...,Cn+i and a potential redex p„ such that 

t = plug {Cn+1 #n ■■■ #1 Ci\pn])- □ 

Evaluating a term using either the derived reduction rules or the substitution-based 
abstract machine from Section f5.3l vields the same result: 

Theorem 6. For any program t and any value v, eval^ (t) = v if and only ift -^^ where 
— >* is the reflexive, transitive closure of — >„ . □ 

As in Section 14.41 using refocusing, one can go from a given reduction semantics of 
Section [5.41 into a pre- abstract machine and the corresponding eval/apply abstract machine 
of Figures d and [HI 

5.5. Beyond CPS. As in Section [4.51 one can define a family of concatenation functions 
over contexts and use it to implement composable continuations in the CPS hierarchy, 
giving rise to a family of control operators J-n and Again the modified environment- 
based abstract machine does not immediately correspond to a defunctionalized continuation- 
passing evaluator. Such control operators go beyond traditional CPS. 

5.6. Static vs. dynamic delimited continuations. As in Section [4.61 one can illustrate 
the difference between static and dynamic delimited continuations in the CPS hierarchy. 
For example, replacing shift2 and reset2 respectively by J-2 and ^2 in Danvy and Filinski's 
version of Abelson and Sussman's generator of triples [28, Section 3] yields a list in reverse 
order.'^ 

5.7. Summary and conclusion. We have generalized the results presented in Section |3 
from level 1 to the whole CPS hierarchy of control operators shift„ and resets . Starting 
from the original evaluator for the A-calculus with shifty and resets that uses n + 1 layers 
of continuations, we have derived two abstract machines, an environment-based one and 
a substitution-based one; each of these machines use n + 1 layers of evaluation contexts. 



'Thanks are due to an anonymous reviewer for pointing this out. 
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Based on the substitution-based machine we have obtained a reduction semantics for the 
A-calculus extended with shifty and resets which, by construction, is sound with respect to 
CPS. 

6. Programming in the CPS hierarchy 

To finish, we present new examples of programming in the CPS hierarchy. The examples 
are normalization functions. In Sections 16.11 and 16.21 we first describe normalization by 
evaluation and we present the simple example of the free monoid. In Section lH^l we present a 
function mapping a proposition into its disjunctive normal form; this normalization function 
uses delimited continuations. In Section 16. 4| we generalize the normalization functions of 
Sections 16.21 and I6.|-il to a hierarchical language of units and products, and we express the 
corresponding normalization function in the CPS hierarchy. 

6.1. Normalization by evaluation. Normalization by evaluation is a 'reduction- free' ap- 
proach to normalizing terms. Instead of reducing a term to its normal form, one evaluates 
this term into a non-standard model and reifies its denotation into its normal form [34]: 

eval : term — > value 

reify : value — > term^^ 
normalize : term — > term^^^ 
normalize = reify o eval 

Normalization by evaluation has been developed in intuitionistic type theory [20,63], 
proof theory [12,13], category theory [4], and partial evaluation [22,23], where it has emerged 
as a new field of application for delimited continuations [9,23,34,44,48,51,78]. 

6.2. The free monoid. A source term in the free monoid is either a variable, the unit 
element, or the product of two terms: 

term 3 t ::= x \ e \ t-kt' 

The product is associative and the unit element is neutral. These properties justify the 
following conversion rules: 

t-k{t'i.t") ^ {ti^t')-kt" 
ti^e ^ t 
e-kt <-> t 

We aim (for example) for list-like flat normal forms: 

term''^ 3 t ::= 6°^ | x -k''^ t 

In a reduction-based approach to normalization, one would orient the conversion rules 
into reduction rules and one would apply these reduction rules until a normal form is 
obtained: 

e-kt t 

In a reduction-free approach to normalization, one defines a normalization function as 
the composition of a non-standard evaluation function and a reification function. Let us 
state such a normalization function. 
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The non-standard domain of values is the transformer 

value = ter-mP^ — > term^^. 

The evaluation function is defined by induction over the syntax of source terms, and 
the reification function inverts it: 

eval X = Xt.x -k^^ t 
eval e = Xt.t 
eval {t -k t') = {eval t) o {eval t') 

reify v = v e^^ 

normalize t = reify ( eval t) 

In effect, eval is a homomorphism from the source monoid to the monoid of transform- 
ers (unit is mapped to unit and products are mapped to products) and the normalization 
function hinges on the built-in associativity of function composition. Beylin, Dybjer, Co- 
quand, and Kinoshita have studied its theoretical content [14,20,58]. From a (functional) 
programming standpoint, the reduction-based approach amounts to flattening a tree itera- 
tively by reordering it, and the reduction- free approach amounts to flattening a tree with 
an accumulator. 

6.3. A language of propositions. A source term, i.e., a proposition, is either a variable, 
a literal (true or false), a conjunction, or a disjunction: 

term 3 t ::= x \ true \ tAt' \ false \ tVt' 

Conjunction and disjunction are associative and distribute over each other; true is neutral 
for conjunction and absorbant for disjunction; and false is neutral for disjunction and 
absorbant for conjunction. 

We aim (for example) for list-like disjunctive normal forms: 

term^^ 3 t ::= d 

termf 3 d ::= false'^^ \ cV°^d 

term^ 3 c ::= true^^ \ xA^^c 

Our normalization function is the result of composing a non-standard evaluation function 
and a reification function. We state them below without proof. 
Given the domains of transformers 

Fi = terrn^^ — > term^^ 

F2 = term^ — > term"^ 

the non-standard domain of values is ans\, where 

ans2 = F2 

ansi = {Fi — > ans2) — > ans2- 
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The evaluation function is defined by induction over the syntax of source terms, and the 
reification function inverts it: 

evaloxkd = k {Xc.x /\^^ c) d 

evalo true kd = k (Ac.c) d 

evalo {t At')kd = evalo t {Xfi.evalo t' {Xf[.k (/i o /{))) d 

evalo false kd = d 

evalo {t V t') k d = evalo t k {evalo t' k d) 

reify ov = v {Xfi.Xd.{fi true''^) y""^ d) false""^ 

normalize t = reify o ( evalo t) 

This normahzation function uses a continuation k, an accumulator d to flatten disjunctions, 
and another one c to flatten conjunctions. The continuation is delimited: the three flrst 
clauses of evalo are in CPS; in the fourth, k is discarded (accounting for the fact that false 
is absorbant for conjunction); and in the last, k is duplicated and used in non-tail position 
(achieving the distribution of conjunctions over disjunctions). The continuation and the 
accumulators are initialized in the definition of reify o- 

Uncurrying the continuation and mapping evalo and reifyo back to direct style yield 
the following definition, which lives at level 1 of the CPS hierarchy: 

evali X d = {Xc.x A°^c, d) 
evali true d = (Ac.c, d) 
evali (t At') d = let (/i, d) = evali t d 

in let {f[, d) = evali t' d 
in if I of[,d) 
evali false d = Sk.d 
evali {t y t') d = Sk.k {evali t {k {evali t' d))) 

reifyi v = {let (/i, d) = vfalse^^ 
in {fi true""^) V^^d) 

normalize t = reifyi (ewo/i t) 

The three first clauses of evali are in direct style; the two others abstract control with 
shift. In the fourth clause, the context is discarded; and in the last clause, the context is 
duplicated and composed. The context and the accumulators are initialized in the definition 
of reifyi. 

This direct-style version makes it even more clear than the CPS version that the ac- 
cumulator for the disjunctions in normal form is a threaded state. A continuation-based, 
state-based version (or better, a monad-based one) can therefore be written — but it is out 
of scope here. 

6.4. A hierarchical language of units and products. We consider a generalization of 
propositional logic where a source term is either a variable, a unit in a hierarchy of units, 
or a product in a hierarchy of products: 

term 3 t ::= x \ | t-kit' 
where 1 < i < n. 



All the products are associative. All units are neutral for products with the same index. 
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The free monoid: The language corresponds to that of the free monoid if n = 1, as 
in Section |ni21 

Boolean logic: The language corresponds to that of propositions if n = 2, as in 

Section ei is true, *i is A, £2 is false, and +2 is V. 
Multi-valued logic: In general, for each n > 2 we can consider a suitable n-valued 
logic [47]; for example, in case n = 4, the language corresponds to that of Belnap's 
bilattice J-OIATZ [11]. It is also possible to modify the normalization function to 
work for less regular logical structures (e.g., other bilattices). 
Monads: In general, the language corresponds to that of layered monads [64]: each 
unit element is the unit of the corresponding monad, and each product is the 'bind' 
of the corresponding monad. In practice, layered monads are collapsed into one for 
programming consumption [43], but prior to this collapse, all the individual monad 
operations coexist in the computational soup. 
In the remainder of this section, we assume that all the products, besides being asso- 
ciative, distribute over each other, and that all units, besides being neutral for products 
with the same index, are absorbant for products with other indices. We aim (for example) 
for a generalization of disjunctive normal forms: 

term^^ 3 t ::= tn 

ferm'^^ ^ f 1 f 1 f 

termf 3 ti ::= | to *f 
terrriQ^ 3 tQ ::= x 

For presentational reasons, in the remainder of this section we arbitrarily fix n to be 5. 

Our normalization function is the result of composing a non-standard evaluation func- 
tion and a reification function. We state them below without proof. Given the domains of 
transformers 



Fi = 


termf^ - 


terraf^ 


F2 = 


term^ - 


->■ term^ 


F3 = 


term^ - 


->■ term^ 


Fa = 


term^ - 


term^ 


F5 = 


term^^ - 


term^^ 



the non-standard domain of values is ansi, where 



ans5 


= F5 






ans4 


= {F, - 


-> ans^) - 


-5> ans5 


ans3 


= {F3 - 


-> ans4,) - 


-i> ans4 


ans2 


= {F2 - 


anss) - 


-i> ans3 


ansi 


= (Fi - 


-> ans2) - 


-> ans2 
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The evaluation function is defined by induction over the syntax of source terms, and the 
reification function inverts it: 

eAHilf] X ki A;2 fcs = ki {Xti.x ti) k2 k^ 

evalo £i ki k2 k^ k^ = ki (Ati.ti) /c2 k^ k^ 

evalo {t -ki t') ki k2 fes ^4 is = evalo t {Xfi.evalo t' (A/{.fci (/i o /{))) ^2 ^3 ^4 ^5 

evalo £2 ki k2 k^ k^ = k2 {\t2.t2) kz k^ 

evalo (t -k2 t') ki k2 k^ k^ = evalo t ^1 (-^/2 • evalo i' ki {Xf2-k2 (/2 ° /2))) ^3 ^4 ^5 

evalo £3 ki ^2 ^3 ^4 ^5 = ^3 (Ai3-*3) ^4 h 

evalo {t *3 t') ki k2 ^3 k^ ^5 = evalo t ki k2 {Xfs. evalo t' ki k2 (Xf^-ks (/s o /^))) k^ 

e?;a/o £4 fei ^2 ^3 ^4 is = A;4 (Ai4.i4) ts 

evalo {t +4 t') ki ^2 ^3 ^4 ^5 = evalo t ki k2 ks {Xfi.evalo t' ki k2 ks {Xf^.k^ (/4 o f'^)) 

evalo £5 ki k2 k^ ^4 ^5 = ^5 

evalo (t *5 t') k\ k2 ks k^ = evalo t ki k2 ks k^ {evalo t' ki k2 ks k^ t^) 

reifvov = v{Xh.Xk2.k2{Xt2-{h^i)*2t2)) 
{Xf2.Xks.ks{Xt3.{f2ef)*f h)) 
{Xh.XkiM{XU.{f3ef)*f M) 
{XU.Xt5.{hef)*ft5) 

normalize t = reify q {evalo t) 

This normahzation function uses four dehmitcd continuations ki, k2, k^, k/^ and five accu- 
mulators ii, t2, ts, t^, trj to fiatten each of the successive products. In the clause of each £j, 
the continuations ki, . . . , ki-i are discarded, accounting for the fact that Si is absorbant for 
★1, . . . and the identity function is passed to ki, accounting for the fact that is neu- 

tral for ★j. In the clause of each the continuations ki, . . . ,ki are duplicated and used 

in non-tail position, achieving the distribution of ★j+i over . . . The continuations 
and the accumulators are initialized in the definition of reify o- 

This normalization function lives at level of the CPS hierarchy, but we can express 
it at a higher level using shift and reset. For example, uncurrying k^ and k^ and mapping 
evalo and reifyo back to direct style twice yield the following intermediate definition, which 
lives at level 2: 

eval2xkik2t^ = ki {Xti.x -k'f ti) k2t5 
eval2 £i ki k2 = ki {Xti.ti) k2 
eval2 {t *i f/) ki k2ts = eua/2 i (A/i.e?;aZ2 (A/{ .fci (/i o /{))) /c2 ts 

ewa/2 £2 ^1 ^2 ^5 = k2{Xt2.t2)h 

eval2 {t-k2t') kik2h = eval2tki{Xf2.eval2t' ki{Xf2.k2{f2° f2)))t5 

eval2e2,kik2h = (At3-*3, ^5) 
eval2 {t -ks t') ki k2 = let {fs, t^) = eval2 t ki k2 

in let (/g, ts) = eval2 t' ki k2 
in {fs o /s, ^5) 
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eval2 £4 ki k2 
eval2 {t *4 t') ki k2 



eval2 £5 k\ k2 
eval2 {t -k^ t') ki k2 



reify 2 v = {let (/4, ts) = {let {fs, t^) 



normalize t 



5ifc3.(At4.t4, ts) 

Sikz-let (/4, ts) = (/ca {eva^tki A;2i5))i 

in let (/4, ts) = (/c3 {evah t' ki k2 ts))! 
in if 4 o /i, is) 

»S2A;4-i5 

S1k3.S2k4.let t^ = {k4 {ks {eval2 t' ki /c2 t5))i)2 
in (/c4 (/C3 (efo/2 t ki k2 t5))i)2 

i;(A/i.Afc2.A:2(At2.(/ief)*2^i2)) 

(A/2.Ai3.(/2 40*t'*3) 

£5 

m (A/4.(/3£f)*f i4, t5)>l 

reify 2 {eval2 t) 

Whereas evalo had four layered continuations, eval2 has only two layered continuations 
since it has been mapped back to direct style twice. Where evalo accesses k^ as one of its 
parameters, eval2 abstracts the first layer of control with shifti, and where evalo accesses 
k4 as one of its parameters, eval2 abstracts the first and the second layer of control with 
shift2. 

Uncurrying ki and /c2 and mapping eval2 and reify2 back to direct style twice yield the 
following direct-style definition, which lives at level 4 of the CPS hierarchy: 

eval^xt^ = {Xti.x -k^ ti., t^) 
{Xti.ti, is) 

let (/i, ^5) = evali tt^ 
in let (/(, t^) = evali t' t^ 

in (/i o /(, tg) 
Siki.{Xt2.t2, t^) 

Siki.let (/2, is) = {ki {evaUtt^))! 

in let (/2, t^) = {ki {evaU t' t5))i 
in (/2 o ts) 

S2k2.iXt3.t3, t5) 

S1k1.S2k2.let (/3, ts) = {k2 {ki {evaUtt5))i)2 

in let (/^, ts) = {k2 {ki {evaU t'i5))i)2 
in (/a o t^) 

S3k3.{Xt4.t4, t^) 

S1k1.S2k2.S3k3.let (/4, t^) = {ks {k2 {ki {evaUtt5))i)2)3 

in let (/4, t^) = {k3 {k2 {ki (evaUt' t5))i)2)3 
in if 4 o /4, is) 

S4k4.t5 

S1k1.S2k2.S3k3.S4k4.let = {k4 {k3 {k2 {ki (em/4 t' t5))i)2)3)4 

in {k4 {k3 {k2 {ki (ewa/4 U5))i)2)3)4 



evaU El ts 
eval4 (t -ki t') t^ 



evaU £2 ^5 
evaU (t *2 t') ts 



evaU £3 is 
evaU {t ^3 t') t5 



eval4 £4 is 
eval4 {t *4 t') is 



evaU £5 is 
eval4 (i *s t') is 
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reify^ v = {let {fi, ts) = {let (/s, ts) = {let (/2, ts) = {let (/i, ts) = v 85 

in {\f2.{hef)^f t2, t5))i 
{\h-{f2ef)^f t3, h))2 
{\h-{hef)^f t^,t,)h 
{hef)^f t5)4 

normalize t = reify 4 ( evaU t) 
Whereas eval2 had two layered continuations, eval^ has none since it has been mapped back 
to direct style twice. Where eval2 accesses ki as one of its parameters, eua/4 abstracts the 
first layer of control with shifti, and where eval2 accesses k2 as one of its parameters, eval^ 
abstracts the first and the second layer of control with shift2- Where eval2 uses reset 1 and 
shifti, evali uses resets and shifts, and where eval2 uses reset2 and shift2, evaU uses reset4 
and shift4. 

6.5. A note about efficiency. We have implemented all the definitions of Section [6.41 as 
well as the intermediate versions evali and eval^ in ML [32]. We have also implemented 
hierarchical normalization functions for other values than 5. 

For high products (i.e., in Section [6.4( for source terms using -k^ and ^4), the normal- 
ization function living at level of the CPS hierarchy is the most efficient one. On the 
other hand, for low products (i.e., in Section for source terms using *i and :*r2), the 
normalization functions living at a higher level of the CPS hierarchy are the most efficient 
ones. These relative efficiencies are explained in terms of resources: 

• Accessing to a continuation as an explicit parameter is more efficient than accessing 
to it through a control operator. 

• On the other hand, the restriction of eval4^ to source terms that only use £1 and *! 
is in direct style, whereas the corresponding restrictions of ewa/2 and evalo pass a 
number of extra parameters. These extra parameters penalize performance. 

The better performance of programs in the CPS hierarchy has already been reported for 
level 1 in the context of continuation-based partial evaluation [61], and it has been reported 
for a similar "pay as you go" reason: a program that abstracts control relatively rarely is run 
more efficiently in direct style with a control operator rather than in continuation-passing 
style. 

6.6. Summary and conclusion. We have illustrated the CPS hierarchy with an applica- 
tion of normalization by evaluation that naturally involves successive layers of continuations 
and that demonstrates the expressive power of shiftn and reset„. 

The application also suggests alternative control operators that would fit better its 
continuation-based programming pattern. For example, instead of representing a delimited 
continuation as a function and apply it as such, we could represent it as a continuation and 
apply it with a 'throw' operator as in MacLisp and Standard ML of New Jersey. For another 
example, instead of throwing a value to a continuation, we could specify the continuation of 
a computation, e.g., with a reflect^ special form. For a third example, instead of abstracting 
control up to a layer n, we could give access to each of the successive layers up to n, e.g., 
with a Cn operator. Then instead of 

evaU {t-kit')t5 = S1k1.S2k2.S3k3. let (f^, t^) = {ks {k2 {ki {evaUt t^)) 1)2) 3 

in let (/^, t^) = {k3 (^2 (fci {evaU t't5))i)2)3 
in (/4 o ts) 
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one could write 

evali (i *4 t')t5 = £3 {ki, /c2, k'ij.let (Z^, t^) = reflect^ (evaUtt^, ki, k2, k^) 

in let (Z^, ts) = reflect^ {evaUt't^, ki, k2, k^) 
in (/4 o /4, ts)- 

Such alternative control operators can be more convenient to use, while being compatible 
with CPS. 

7. Conclusion and issues 

We have used CPS as a guideline to establish an operational foundation for delimited 
continuations. Starting from a call- by- value evaluator for A-terms with shift and reset, 
we have mechanically derived the corresponding abstract machine. From this abstract 
machine, it is straightforward to obtain a reduction semantics of delimited control that, 
by construction, is compatible with CPS — both for one-step reduction and for evaluation. 
These results can also be established without the guideline of CPS, but less easily. 

The whole approach generalizes straightforwardly to account for the shifty and resets 
family of delimited-control operators and more generally for any control operators that are 
compatible with CPS. These results would be non-trivial to establish without the guideline 
of CPS. 

Defunctionalization provides a key for connecting continuation-passing style and oper- 
ational intuitions about control. Indeed most of the time, control stacks and evaluation 
contexts are the defunctionalized continuations of an evaluator. Defunctionalization also 
provides a key for identifying where operational intuitions about control go beyond CPS 
(see Section . 

We do not know whether CPS is the ultimate answer, but the present work shows yet 
another example of its usefulness. It is like nothing can go wrong with CPS. 
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